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INPUT NEW MPEG-2 FILE AND 
CREATE REDUCED-QUALITY 
MPEG FILE AS AVAILABLE 
RESOURCES PERMIT 




YES 



NO 




YES 



BROWSE THROUGH 
REDUCED-QUALITY 
MPEG FILE TO SELECT 
IN-POINTS AND 
OUT-POINTS OF CLIPS 
TO BE SPLICED 



56 



STREAM COMPRESSED 
VIDEO FROM REDUCED 
QUALITY MPEG FILE 



60 



STREAM ORIGINAL QUALITY l-FRAMES 
AND 3 FREEZE FRAMES PER l-FRAME 




STREAM ORIGINAL 
QUALITY MPEG-2 
CODED VIDEO 



SELECT 1 OR 2 FREEZE FRAMES PER 
l-FRAME FOR DESIRED SPEED-UP 



62 



STREAM REDUCED-QUALITY l-FRAMES 
AND INSERTED FREEZE FRAMES 
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( MPEG SPLICING ^ 



INPUT DESIRED END FRAME OF FIRST CLIP AND 
DESIRED START FRAME OF SECOND CLIP 



121 



FIND CLOSEST I FRAME PRECEDING DESIRED START 
FRAME TO BE THE IN-POINT FOR SPLICING 



— 122 



ADJUST CONTENT OF THE FIRST CLIP NEAR THE END 
FRAME OF THE FIRST CLIP AND ADJUST CONTENT OF 
THE SECOND CLIP NEAR THE IN POINT IN ORDER TO 
REDUCE PRESENTATION DISCONTINUITY AND PREVENT 
DECODER BUFFER OVERFLOW WHEN DECODING 
THE SPLICED MPEG STREAM 



-—123 



RE-FORMATTING INCLUDING RE-STAMPING OF 
PTS, DTS AND PCR'S FOR AUDIO AND VIDEO 



( END ) 

Fig. 3 



— 124 



0 
1 
2 



HASH 
TABLE 



1 



0 



0 



300 



HASH 
LISTS 



301 



CINDEX 


XXXX 


XXXX 


X • • • X 


XXXX 


XXXX 


XXXX 
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XXXX 
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CINDEX 


CINDEX 


X • • • X 


CINDEX 


CINDEX 
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XXXX 
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XXXX 
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CINDEX 


XXXX 


XXXX 
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XXXX 


XXXX 


XXXX 
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Fig. 18 
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( SEAMLESS VIDEO SPLICING ) 



141 



ANCHOR THE FIRST DTS OF THE SECOND CLIP 
AT ONE FRAME INTERVAL LATER THAN THE 
LAST DTS OF THE FIRST CLIP TO PREVENT 
VIDEO DECODING DISCONTINUITY 



DOES 

142-^ ^ THEPCR 

EXTRAPOLATED TO 
THE BEGINNING FRAME OF THE 
SECOND CLIP FALL JUST 
AFTER THE ENDING 
TIME OF THE FIRST 
CLIP 
? 

NO 



YES 



143 — 



ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE 
BEGINNING FRAME OF THE 
SECOND CLIP FALLS JUST 
AFTER THE ENDING TIME OF 
THE FIRST CLIP 



C END ) 



Fig. 4 
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( VIDEO SPLICING ) 



1 


r 


DETERMINE THE LAST DTS/PTS OF THE FIRST CLIP 

( DTSli ) 



151 



DETERMINE THE TIME OF ARRIVAL ( Te ) 
OF THE LAST BYTE OF THE FIRST CLIP 



— 152 



ADD ONE FRAME INTERVAL TO DTSli 
TO FIND THE DESIRED FIRST DTS 
LOCATION FOR THE SECOND CLIP 
( DTSfi =DTSli +1/FR ) 



KEEPING THE DTS-PCRe RELATION UNALTERED 
FOR THE SECOND CLIP, FIND THE TIME INSTANT 
Ts AT WHICH THE FIRST BYTE OF THE SECOND 
CLIP SHOULD ARRIVE 
(TsTART =DTSf2 -PCRe2 ) 

(Ts =DTSfi -T start ) 



B 

Fig. 5 




YES 

^158 



OPEN UP A CERTAIN AMOUNT OF SPACE 
IN THE FIRST CLIP TO ACHIEVE 
8 

Ts =Te + 

BIT RATE 

THE NUMBER OF BYTES TO DROP IS 

^ ( Te - Ts ) ( BIT RATE ) 
1 + 

8 

IF POSSIBLE, REMOVE NULL PACKETS TO 
DROP THE BYTES, OTHERWISE, REPLACE 
ONE OR MORE FRAMES AT THE END OF 
THE FIRST CLIP WITH CORRESPONDING 
REDUCED-QUALITY FRAMES. 



159 — 



CONCATENATE 
THE STREAMS 



160 — 



COMPUTE THE VIDEO TIME 
STAMP OFFSET Vqffset 



-( END ) 
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Fig. 7 
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VPUi 



APUi 



B 

VPUi+1 
APU 



j+1 



B 

VPUi+2 



B 









VPUk3 


VPUi+4 





APU 



j+2 



APU 



j+3 



APU 



j+4 



APU 



Fig. 8 



VPUi 



VPUi 



VPUi 



I 

VPUi+15 



APUi 



APU 



j+1 



APU 



j+2 



APUj+3 



APUk 



VPUkis 
APUk+1 



( TRICK MODE AUDIO ALIGNMENT ) 




175 



BEGIN NEXT APU 



174 



INCREMENT 
APU POINTER 



ADVANCE APU POINTER TO THE FIRST 
APU BEGINNING IN THE DURATION OF 
THE VPU OF THE l-FRAME IN THE 
ORIGINAL MPEG-2 STREAM 



Fig. 9 
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iffi 



( TRICK MODE STREAivT) 



181 



INPUT MPEG-2 TS FROM 
WHICH A TRICK MODE 
CLIP WILL BE EXTRACTED 



182 



VIDEO ELEMENTARY STREAM 
( VES ) EXTRACTED 



184 



I FRAME EXTRACTION AND 
VALID PES FORMATION 



185 



SNR SCALING OF THE 
l-FRAMES-ONLY PES 



FREEZE P FRAME INSERTION 
AND VALID PES FORMATION 


188^ , 





TS STREAM GENERATION BY 
MULTIPLEXING THE ABOVE 
VIDEO PES INTO A SYSTEM 
INFO (SI) AND AUDIO PES 
CARRYING TS SKELETON 



183 



AUDIO ELEMENTARY STREAM 
(AES ) EXTRACTED 



187 



SELECTION AND CONCATENATION 
OF THE APPROPRIATE AUDIO ACCESS 
UNITS (FROM THE ORIGINAL ASSET) 
BASED ON THE STRUCTURE OF THE 
VES IN THE TRICK MODE CLIP AND 
VALID PES ENCAPSULATION AROUND 
THESE AUDIO ACCESS UNITS 



( END ) 

Fig. 10 
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( MPEG SCALING ) 



221 




■222 



REMOVE DCT COEFFICIENTS 
FOR SPATIAL FREQUENCIES 
IN EXCESS OF THE NYQUIST 
FREQUENCY FOR THE 
DOWNSAMPLED VIDEO 



NO 



YES 





225 



RETAIN UP TO A CERTAIN NUMBER OF 
LOWEST-ORDER AC DCT COEFFICIENTS 
FOR EACH BLOCK AND REMOVE ANY 
ADDITIONAL AC DCT COEFFICIENTS 
FOR EACH BLOCK 



■227 



RETAIN UP TO A CERTAIN NUMBER OF 
LARGEST MAGNITUDE AC DCT 
COEFFICIENTS FOR EACH BLOCK 
AND REMOVE ANY ADDITIONAL AC 
DCT COEFFICIENTS FOR EACH BLOCK 



■229 



RETAIN UP TO A CERTAIN NUMBER 
OF AC DCT COEFFICIENTS THAT 
DIFFER IN MAGNITUDE FROM UP 
TO THAT NUMBER OF LARGEST 
MAGNITUDE AC DCT COEFFICIENTS 
BY NO MORE THAN A CERTAIN LIMIT 



( RETURN ^ 



Fig. 13 
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( FDSNR-LP ) 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC. 



— 24 J 



LETL=0 — 242 



■243 



PARSE THE NEXT (RUN, LEVEL) EVENT VLC. 



244 




■245 



YES 


COPY 






VLC 





246 



NO 



LET R= RUN LENGTH OF ZEROES FOR 
THE CURRENT (RUN, LEVEL) EVENT 



247 



251 



LET 

L=L+R+1 




■248 



YES 



COPY EOB 
MARKER 



■253 



YES 



COPY 
VLC 



250 



COPY 
VLC 



— 252 



254 — 



COPY EOB 
MARKER 



249 — 



PARSE UNTIL THE END OF THE NEXT EOB 
MARKER IN THE INPUT BIT STREAM 



Fig. 14 C 

RETURN } 

l_ 
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c 



FDSNR-LM 



:) 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 



—261 



PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLCs UNTIL AND INCLUDING 
THE FIRST EOB MARKER 



—262 



TRANSFORM THE QUANTIZATION INDICES 
TO QUANTIZED COEFFICIENT VALUES 



—263 



SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THEIR MAGNITUDES 



—264 



KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 



— 265 



APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 



COPY THE RESULTING VLCs TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 



—267 



( return"^ 



Fig. 15 
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Q SORT K FROM N ^ 



O —281 



■282 



GET NEXT COEFFICIENT 
FROM INPUT STREAM 



283 




EOB 

9 



YES 



284 



NO 



( RETURN ) 



287 



SORT THE 
LIST OF K 
COEFFICIENTS 
BY MAGNITUDE 




NO 



YES 



■285 



PUT COEFFICIENT 
INDEX AND MAGNITUDE 
INTO SORT LIST 



1 + 1 —286 



288 



COEFFICIENT YES 
MAGNITUDE > MAGNITUDE 
AT END OF LIST 
9 



® — - 


NO 


1 


GET NEXT COEFFICIENT 
FROM INPUT STREAM 




r 



289 



NO 



290 




( RETURN ) 



■291 



REMOVE ENTRY AT THE 
END OF THE LIST 



■292 



BINARY SEARCH FOR RANK 
POSITION OF CURRENT 
COEFFICIENT 



■293 



INSERT CURRENT 
COEFFICIENT INDEX AND 
MAGNITUDE INTO THE LIST 
AT THE RANK POSITION 



Fig. 17 



APPROXIMATE 
SORT K FROM N 



311 



CLEAR HASH TABLE 



■312 



GET NEXT 
COEFFICIENT FROM 
INPUT STREAM 



313 




EOB 



YES 



NO 



■314 



STRIP HASH TABLE 
INDEX FROM MSBs 
OF COEFFICIENT 
MAGNITUDE 



■315 



INSERT COEFFICIENT 
INDEX ON HASH 
LIST OF INDEXED 
HASH TABLE ENTRY 



Fig. 19 
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O 



■316 



K 



317 



INDEX HASH 
TABLE WITH i 



318 




YES 



320 



319 



NO 



321 



GET NEXT ENTRY FROM 
HASH LIST AND PUT 
COEFFICIENT IN THE 
OUTPUT STREAM 




( RETURN J 




( RETURN ) 
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Y MODIFIED \ 
FDSNR-LM J 

FIND UP TO k LARGEST MAGNITUDE NON-ZERO 
AC DCT COEFFICIENTS (i.e., THE "QUALIFYING 
COEFFICIENTS") FOR THE BLOCK 



332 ^337 

CONTINUE (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER USING THE SECOND 
CODING TABLE 



BEGIN (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER. USING THE SECOND 
CODING TABLE (TABLE 1) 




IF POSSIBLE, INCLUDE A NON-ZERO, 
NON-QUALIFYING AC DCT COEFFICIENT 
IN THE (RUN LEVEL) CODING TO 
ELIMINATE THE ESCAPE SEQUENCE 



335 




YES 



( RETURN ) 

Fig. 20 



l_ 
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( ATTEMPT ELIMINATION OF ESCAPE SEQUENCE ) Fig 21 



■341 



IDENTIFY THE FIRST QUALIFYING 
COEFFICIENT AND THE SECOND 
QUALIFYING COEFFICIENT 
CAUSING THE ESCAPE SEQUENCE 



■342 



LOOK FOR A NON-ZERO. 
NON-QUALIFYING AC DOT 
COEFFICIENT BETWEEN THE 
FIRST AND THE SECOND 
QUALIFYING COEFFICIENTS IN 
THE SCAN ORDER SEQUENCE 






NO Z' RETURN 

UNSUCCESSFUL 


344 , 




(RUN, LEVEL) CODE THE NON-ZERO 
NON-QUALIFYING COEFFICIENT 


345-^ J 





) 



ESCAPE 
SEQUENCE 

? 

NO 



YES 



■346 



(RUN, LEVEL) CODE THE SECOND 
QUALIFYING COEFFICIENT. 
USING THE NEW RUN LENGTH 



347 




YES 




NO 



SEARCH FOR 
ADDITIONAL NON-ZERO 
NON-QUALIFYING 
COEFFICIENTS THAT 
WILL ELIMINATE THE 
ESCAPE SEQUENCE 




SELECT THE 
NON-QUALIFYING 
COEFFICIENT GIVING THE 
SHORTEST OVERALL 
CODE LENGTH AND/OR 
THE LARGEST MAGNITUDE 
FOR THE BEST PSNR 



RETURN 
SUCCESSFUL 



l_ 



( MPEG SCALING ) 



9, QSF-^2 — 361 
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Fig. 22 



362 




363 



YES 



INTRA 
VLC - FORMAT 
= O 

9 



364 



YES 



READ IN TABLE O 



NO 



384 



NO 



■365 



READ IN TABLE 1 



NO 



0 




YES 



{ RETURN ) 



■366 



APPLY MODIFIED FDSNR-LM PROCEDURE, USING 
ADJUSTED QUANTIZER SCALE INDEX IF LESS THAN 
THE MAXIMUM POSSIBLE QUANTIZER SCALE INDEX 
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NO 



NO 



ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED QUANTIZER 
SCALE AND SELECT NEW CODING OR 
CODING THAT GIVES BEST RESULTS 




NO 




YES 



377 



YES 



380 




YES 



■378 



k-1 




YES 



■381 



k +1 



NO 



382 



NO 



383 




ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED k VALUE 



BACKTRACK 
OPTION 

Ves 



0 
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GOP= IBBPBBPBBP 



GOP= I 



MAIN 
FILE 



391 




Fig. 26A 



L_ 
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1- Play from start 1 sec 

2- Pause 

3- Fast Forward to 29 min 

F^S* 26B 5. Play 1 sec 

6- Pause 

7- Fast Reverse to 1 sec 

8- Pause 

9- Play Normal 





READ 


WRITE 


COPY OF THE ASSET 
WITH ALL THE DATA 


EMPEG2 


EMPEG2 


COPY ONLY THE 
MAIN ASSET 


RAW 


MPEG2 


ARCHIVE 


EMPEG2 


EMPEG2 


PLAY 


MPEG2 




RECORD 




MPEG2 



Fig. 27 



MpegFast 



MpegFastForward 



TrickFilesAccess 



MpegFastReverse 



RealTimeFastFwd TrickFllesGenerate 



RealTimeFastRev 



Fig. 28 
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FDSNR-LMIS 
WITHOUT PIVOTING 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 



— 461 



PARSE AND DECODE ALL (RUN, LEVEL) 
EVENT VLCs UNTIL AND INCLUDING 
THE EOB MARKER 



—462 



SORT THE QUANTIZATION INDICES 
IN DESCENDING ORDER OF THEIR 
MAGNITUDES 



— 463 



KEEP THE FIRST K INDICES OF THE 
SORTED LIST AND SET THE LAST 63-K 
INDICES OF THE SORTED LIST TO ZERO 



— 464 



APPLY (RUN, LEVEL) EVENT FORMATION AND 
ENTROPY ENCODING TO THE NEW SET OF INDICES 



— 465 



COPY THE RESULTING VLCs TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 



— 466 



Q RETURN ) 



Fig. 30 
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COMPARISON OF LMCS AND LMIS PROCEDURES FOR 

qsv=2,4,6, AND 8 



45 



40 



35 



30 





— ^ 
# — 

1 
1 


- NO 

- NO 

- NO 


PIVOT 
PIVOT 
PIVOT 


FORc 
FORc 
FORc 

rKJW C 


|sv= 2 
|sv= 4 
|sv= 6 

io\# — Q 
|SV— O 


















LMIS- 




LMI 


s^^ Jt 


-LMC 


LMIi 

S 
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L^ 

LM 


MCS- 
CSkJ 














/ISC 















































1 2 3 4 5 6 7 8 9 10 11 



NUMBER OF BITS USED FOR ONLY AC COEFFICIENTS' ENCODING xlO 



Fig. 31 
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38- 



a: 
z 
w 

Q- 



COMPARISON OF LMCS AND LMIS PROCEDURES FOR 
qsv=12,16,20, AND 24 



NO PIVOT FOR qsv= 12 
NO PIVOT FORqsv= 16 
NO PIVOT FOR qsv= 20 
NO PIVOT FOR qsv= 24 




0.5 1 1.5 2 2.5 3 3.5 

NUMBER OF BITS USED FOR ONLY AC COEFFICIENTS' ENCODING xlO ^ 



Fig. 32 
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REDUCTION OF THE NUMBER OF BITS FOR 
RUN-LEVEL ENCODING OF TRANSFORM 
COEFFICIENTS OF A BLOCK-CODED PICTURE 



■481 



PIVOT-1 TECHNIQUE 

SELECTIVELY RETAIN NON-QUALIFYING 
NON-ZERO AC COEFFICIENTS IN ORDER 
TO AVOID ESCAPE SEQUENCES 



■482 



PIVOT-2 TECHNIQUE 



REDUCE THE MAGNITUDE OF THE LEVEL OF 
THE RETAINED NON-QUALIFYING NON-ZERO 
AC COEFFICIENTS TO A VALUE OF ONE IN 
ORDER TO ELIMINATE MORE ESCAPE 
SEQUENCES AND TO REDUCE THE NUMBER 
OF BITS FOR (RUN, LEVEL) ENCODINGS 



,r ^48 3 

PIVOT-3 TECHNIQUE 

AVOID ESCAPE SEQUENCES AND/OR REDUCE 
THE NUMBER OF BITS FOR (RUN, LEVEL) 
ENCODING BY SELECTIVELY INSERTING A 
NOISE COEFFICIENT OF LEVEL MAGNITUDE 
EQUAL TO ONE (I.E., A PIVOT POINT WHICH IS A 
ZERO-VALUE AC COEFFICIENT IN THE 
ENCODING OF THE ORIGINAL PICTURE) IN THE 
SCAN ORDER JUST BEFORE EACH QUALIFYING 
NON-ZERO AC COEFFICIENT 



Fig. 33 
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THE EFFECT OF PIVOT TECHNIQUES ON THE ESCAPE 
SEQUENCE COUNT GENERATED BY LMCS FOR qsv=4 



7000 




5 10 15 20 25 30 35 

NUMBER OF AC COEFFICIENTS RETAINED IN EACH BLOCK 



Fig. 34 
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THE EFFECT OF PIVOT TECHNIQUES ON THE ESCAPE 

SEQUENCE COUNT GENERATED BY LMCS 
FOR qsv=24 




LMCS+NO PIVOT 
LMCS+PIVOT-1 
LMCS+PIVOT-2 
LMCS+PIVOT-3 



5 ,10 15 20 25 30 35 

NUMBER OF AC COEFFICIENTS RETAINED IN EACH BLOCK 



Fig. 35 
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• • • Cj Ck 

^ y ' 

R ZERO-LEVEL 
COEFFICIENTS 



COEFFICIENT 
SCAN ORDER 



Fig. 36 



LEVEL MAGNITUDE 



40 41 

_J i_ 



2048 



PARTIAL 

PIVOT 

TABLE 



497 



NO PIVOT 
(ZERO) 



Fig. 37 
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INSERTION OF PIVOTS FOR ENHANCING 
COMPRESSION EFFICIENCY 



501 — 



GET NEXT 
BLOCK 



502 



END\^ YES . ^ 

JDF STREAM> END J 



NO 



GET NEXT INDEX 
TO BE CODED 



504 



— 503 




YES 





NO 




DETERMINE THE NEXT 
(RUN, LEVEL) PAIR (M,N) 


— 505 




r 




LOOKUP THE PIVOT TABLE 


— 506 








Fig. 38 
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C3 



LOOKUP THE INDEX BLOCK FOR 
THE IMMEDIATELY PRECEDING 
LOCATION TO SEE IF THERE IS AN 
INDEX DECIDED TO BE DISCARDED 



509 



— 508 




NO 



LOOKUP THE VLC 
TABLE FOR (M-1,1) 



— 511 



YES 



LOOKUP THE VLC TABLE 
FOR (M-1, SIGN(INDEX)*1) 



— 510 



LOOKUP THE VLC 
TABLE FOR (0,N) 



LOOKUP THE VLC 
TABLE FOR (M.N) 



— 513 



Fig. 39 
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LOOKUP THE 
PIVOT TABLE 



521 




YES 



523 



YES 





NO 


MAG — ABS(LEVEL) 


526-^ J 





— 525 



MAO40 

9, 



YES 





NO 




r ^527 


LOOKUP THE PARTIAL 


PIVOT TABLE 


PPTV-" PPT(RUN, MAG) 


528^ J 





529 



■522 



DO NOT INSERT 
A PIVOT 



^524 



INSERT A PIVOT 



( RETURN ) 




Fig. 40 



l_ 
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ORIGINAL 

BLOCK-CODED 
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